Jump to content

Expanded AI Model with Global Data Enhances Earth Science Applications 


Recommended Posts

  • Publishers
Posted

4 min read

Expanded AI Model with Global Data Enhances Earth Science Applications 

A false-color image of the East Peak fire burning in southern Colorado near Trinidad, captured by the Operational Land Imager on the Landsat 8 satellite. Dark green forests and light green grasslands cover most of the image, but a red patch in the middle represents a burn scar, and some orange spots around it represent actively burning areas.
On June 22, 2013, the Operational Land Imager (OLI) on Landsat 8 captured this false-color image of the East Peak fire burning in southern Colorado near Trinidad. Burned areas appear dark red, while actively burning areas look orange. Dark green areas are forests; light green areas are grasslands. Data from Landsat 8 were used to train the Prithvi artificial intelligence model, which can help detect burn scars.
NASA Earth Observatory

NASA, IBM, and Forschungszentrum Jülich have released an expanded version of the open-source Prithvi Geospatial artificial intelligence (AI) foundation model to support a broader range of geographical applications. Now, with the inclusion of global data, the foundation model can support tracking changes in land use, monitoring disasters, and predicting crop yields worldwide. 

The Prithvi Geospatial foundation model, first released in August 2023 by NASA and IBM, is pre-trained on NASA’s Harmonized Landsat and Sentinel-2 (HLS) dataset and learns by filling in masked information. The model is available on Hugging Face, a data science platform where machine learning developers openly build, train, deploy, and share models. Because NASA releases data, products, and research in the open, businesses and commercial entities can take these models and transform them into marketable products and services that generate economic value. 

“We’re excited about the downstream applications that are made possible with the addition of global HLS data to the Prithvi Geospatial foundation model. We’ve embedded NASA’s scientific expertise directly into these foundation models, enabling them to quickly translate petabytes of data into actionable insights,” said Kevin Murphy, NASA chief science data officer. “It’s like having a powerful assistant that leverages NASA’s knowledge to help make faster, more informed decisions, leading to economic and societal benefits.”

AI foundation models are pre-trained on large datasets with self-supervised learning techniques, providing flexible base models that can be fine-tuned for domain-specific downstream tasks.

Three images show the process of crop classification with NASA and IBM’s open-source Prithvi Geospatial artificial intelligence model. The first shows a true color composite image of a cropland area. The second shows a Ground Truth Mask of the types of land cover in the image — natural vegetation is colored red, forest is orange, corn is yellow, soybeans are light green, wetlands are mid-green, developed or barren land is darker green, open water is light blue, winter wheat is mid-blue, alfalfa is dark blue, fallow/idle cropland is dark purple, cotton is pink, and sorghum is dark pink. The third image shows a Predicted Mask that closely matches the Ground Truth Mask.
Crop classification prediction generated by NASA and IBM’s open-source Prithvi Geospatial artificial intelligence model.

Focusing on diverse land use and ecosystems, researchers selected HLS satellite images that represented various landscapes while avoiding lower-quality data caused by clouds or gaps. Urban areas were emphasized to ensure better coverage, and strict quality controls were applied to create a large, well-balanced dataset. The final dataset is significantly larger than previous versions, offering improved global representation and reliability for environmental analysis. These methods created a robust and representative dataset, ideal for reliable model training and analysis. 

The Prithvi Geospatial foundation model has already proven valuable in several applications, including post-disaster flood mapping and detecting burn scars caused by fires.

One application, the Multi-Temporal Cloud Gap Imputation, leverages the foundation model to reconstruct the gaps in satellite imagery caused by cloud cover, enabling a clearer view of Earth’s surface over time. This approach supports a variety of applications, including environmental monitoring and agricultural planning.  

Another application, Multi-Temporal Crop Segmentation, uses satellite imagery to classify and map different crop types and land cover across the United States. By analyzing time-sequenced data and layering U.S. Department of Agriculture’s Crop Data, Prithvi Geospatial can accurately identify crop patterns, which in turn could improve agricultural monitoring and resource management on a large scale. 

The flood mapping dataset can classify flood water and permanent water across diverse biomes and ecosystems, supporting flood management by training models to detect surface water. 

Wildfire scar mapping combines satellite imagery with wildfire data to capture detailed views of wildfire scars shortly after fires occurred. This approach provides valuable data for training models to map fire-affected areas, aiding in wildfire management and recovery efforts.

Three images show the process of burn scar mapping with NASA and IBM’s open-source Prithvi Geospatial artificial intelligence model.The first shows a true color composite satellite image, which contains shades of green and purple. The second shows a Ground Truth Mask, which shows the true extent of a burn scar on the land by blacking out the area around the burn scar. The third shows a Predicted Mask, which almost exactly matches the Ground Truth Mask.
Burn scar mapping generated by NASA and IBM’s open-source Prithvi Geospatial artificial intelligence model.

This model has also been tested with additional downstream applications including estimation of gross primary productivity, above ground biomass estimation, landslide detection, and burn intensity estimations. 

“The updates to this Prithvi Geospatial model have been driven by valuable feedback from users of the initial version,” said Rahul Ramachandran, AI foundation model for science lead and senior data science strategist at NASA’s Marshall Space Flight Center in Huntsville, Alabama. “This enhanced model has also undergone rigorous testing across a broader range of downstream use cases, ensuring improved versatility and performance, resulting in a version of the model that will empower diverse environmental monitoring applications, delivering significant societal benefits.”

The Prithvi Geospatial Foundation Model was developed as part of an initiative of NASA’s Office of the Chief Science Data Officer to unlock the value of NASA’s vast collection of science data using AI. NASA’s Interagency Implementation and Advanced Concepts Team (IMPACT), based at Marshall, IBM Research, and the Jülich Supercomputing Centre, Forschungszentrum, Jülich, designed the foundation model on the supercomputer Jülich Wizard for European Leadership Science (JUWELS), operated by Jülich Supercomputing Centre. This collaboration was facilitated by IEEE Geoscience and Remote Sensing Society.  

For more information about NASA’s strategy of developing foundation models for science, visit https://science.nasa.gov/artificial-intelligence-science.

Share

Details

Last Updated
Dec 04, 2024

Related Terms

View the full article

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Similar Topics

    • By NASA
      Since joining NASA in 2017 as a contractor supporting the International Space Station, Caroline Cawthon has held many roles supporting real-time operations as a certified flight controller, team lead, and lead systems engineer.  
      Caroline Cawthon’s official NASA portrait. NASA is one of the biggest most impressive networks of engineering, science, and space program expertise in the world and to not leverage that experience in mentorship would be a waste.
      Caroline Cawthon
      CLDP Engineering and Integration Lead
      Now, she is supporting America’s future in orbit as the systems engineering and integration lead for NASA’s Commercial Low Earth Orbit Development Program engineering technical authority. Cawthon supports the program’s chief engineer office. In this position, she plays a key role in the oversight of phase 1 partner requirements and processes as part of the program’s two-phase approach to support the development of commercial space stations. 
      Growing up in military and NASA communities, Cawthon was fascinated with aviation and aerospace from a young age and aspired to become a fighter pilot and engineer. She first met an astronaut while attending Space Camp at the Euro Space Center in Belgium, sparking her interest in human spaceflight and solidifying her goals to work for NASA, make an impact, and be a part of making history. She later earned her bachelor’s degree in chemical and materials engineering and her master’s degree in aeronautics and space systems. 
      Cawthon attending Space Camp as a child at the Euro Space Center in Belgium. Image courtesy of Caroline Cawthon Cawthon describes the best part of her day as the people she works with, and her passionate and mission-driven team reminds her that the mission she’s working toward will make a difference in the future of human spaceflight.
      “Between the program, engineering team, and our industry partners, there are thousands of years of experience with human spaceflight that I get to leverage every day to learn and grow in my role and to help NASA accomplish our mission,” shared Cawthon. 
      A recent example of this mission-driven teamwork was the development of the program’s technical standards design evaluation document. As the lead for this task, Cawthon was proud of how everyone’s hard work and contributions came together. 
      The biggest lesson Cawthon has learned while working with NASA is to continue being curious, learning, and growing both personally and professionally.  
      “NASA is one of the biggest most impressive networks of engineering, science, and space program expertise in the world and to not leverage that experience in mentorship would be a waste,” Cawthon said. 
      Cawthon pictured with her husband and daughter. Image courtesy of Caroline Cawthon Outside of work, Cawthon enjoys spending time outdoors with her husband and daughter. She and her family also like to be on the road, exploring new places and meeting new people. They enjoy international travel and small weekend adventures like the local zoo and aquarium.  
      Learn more about NASA’s Commercial Low Earth Orbit Development Program at:
      Commercial Space Stations
      View the full article
    • By NASA
      After months of groundbreaking research, exploration, and teamwork aboard the International Space Station, NASA’s SpaceX Crew-9 has returned to Earth.  
      NASA astronauts Nick Hague, Suni Williams, and Butch Wilmore, as well as Roscosmos cosmonaut Aleksandr Gorbunov, splashed down safely on March 18, 2025, as a pod of dolphins circled the Dragon spacecraft near Tallahassee, Florida. 
      NASA astronauts Nick Hague, Suni Williams, Butch Wilmore, and Roscosmos cosmonaut Aleksandr Gorbunov aboard the SpaceX Dragon spacecraft in the water off the coast of Tallahassee, Florida, March 18, 2025.NASA/Keegan Barber Williams and Wilmore made history as the first humans to fly aboard Boeing’s Starliner spacecraft during NASA’s Boeing Crew Flight Test (CFT). Launched June 5, 2024, aboard a United Launch Alliance Atlas V rocket from Cape Canaveral Space Force Station, the CFT mission was Boeing’s first crewed flight.  
      Hague and Gorbunov launched to the space station on Sept. 28, 2024, aboard a SpaceX Falcon 9 rocket from Space Launch Complex 40 at Cape Canaveral Space Force Station in Florida. 
      NASA’s SpaceX Crew-9 members pose together for a portrait inside the International Space Station’s Unity module. From left, are NASA astronaut Suni Williams, Roscosmos cosmonaut Aleksandr Gorbunov, and NASA astronauts Nick Hague and Butch Wilmore.NASA During their long-duration mission, the American crew members conducted more than 150 unique experiments and logged over 900 hours of research aboard the orbiting laboratory.  
      Their work included studying plant growth and development, testing stem cell technology for patient care on Earth, and examining how spaceflight affects materials—insights vital for future deep space missions.  
      The crew kicked off 2025 with two spacewalks that included removing an antenna assembly from the station’s truss, collecting microbial samples from the orbital outpost’s exterior for analysis by Johnson’s Astromaterials Research and Exploration Science division, installing patches to cover damaged areas of light filters on an X-ray telescope, and more. 
      Williams now holds the record for the most cumulative spacewalking time by a woman — 62 hours and 6 minutes — placing her fourth among the most experienced spacewalkers in history. 
      While in orbit, the crew also engaged the next generation through 30 ham radio events with students around the world and supported a student-led genetic experiment. 
      As part of the CFT, Williams and Wilmore commanded Starliner during in-flight testing and were the first to see the spacecraft integrated in simulations and operate it hands-on in space, evaluating systems like maneuvering, docking, and emergency protocols. 
      “We’ve learned a lot about systems integrated testing that will pay benefits going forward and lay the groundwork for future missions,” said Wilmore.  
      Suni Williams and Butch Wilmore participate in an emergency operations simulation in the Boeing Starliner simulator at Johnson Space Center in Houston.NASA/Robert Markowitz  Following the test flight, NASA and Boeing are continuing work toward crew certification of the company’s CST-100 Starliner system. Joint teams are addressing in-flight anomalies and preparing for propulsion system testing ahead of the next mission. 
      Despite the unexpected challenges, including technical issues with the Starliner spacecraft that extended their mission, both Wilmore and Williams said they would do it all over again. Wilmore emphasized his gratitude in being part of testing Starliner’s capabilities, stating, “I’d get on it in a heartbeat.”  
      After returning to Earth, the crew received a warm welcome from family, colleagues, and fellow astronauts at Johnson Space Center’s Ellington Field. They were greeted by Johnson Acting Director Steve Koerner, who applauded their dedication and resilience. 
      Suni Williams is greeted by Johnson Acting Director Steve Koerner at Ellington Field in Houston after completing a long-duration science mission aboard the International Space Station.NASA/Robert Markowitz Williams shared a heartfelt embrace with astronaut Zena Cardman, thanking her for “taking one for the team.” Cardman had originally been assigned to Crew-9, but in August, NASA announced the uncrewed return of Starliner to Earth and integrated Wilmore and Williams into Expedition 71/72 for a return on Crew-9. This adjustment meant Cardman and astronaut Stephanie Wilson would no longer fly the mission—a decision that underscored the flexibility and teamwork essential to human spaceflight. 
      Cardman is now assigned as commander of NASA’s SpaceX Crew-11 mission, set to launch in the coming months to the International Space Station for a long-duration science expedition. 
      Butch Wilmore receives a warm welcome from NASA astronauts Reid Wiseman and Woody Hoburg at Ellington Field.NASA/Robert Markowitz Williams and Wilmore each brought decades of experience to the mission. Wilmore, a retired U.S. Navy captain and veteran fighter pilot, has logged 464 days in space over three flights. Outside of NASA, he serves as a pastor, leads Bible studies, and participates in mission trips across Central and South America. A skilled craftsman, he also builds furniture and other pieces for his local church. 
      Growing up in Tennessee, Wilmore says his faith continues to guide him, especially when navigating the uncertainties of flight. 
      Expedition 72 Flight Engineer Butch Wilmore works inside the International Space Station’s Columbus laboratory module to install the European Enhanced Exploration Exercise Device.NASA Wilmore encourages the next generation with a call to action: “Strap on your work hat and let’s go at it!” He emphasizes that tenacity and perseverance are essential for achieving anything of value. Motivated by a sense of patriotic duty and a desire to help those in need, Wilmore sees his astronaut role as a commitment to both his country and humanity at large.  
      Wilmore believes he’s challenged every day at NASA. “Doing the right things for the right reasons is what motivates me,” he said.  
      Expedition 72 Commander Suni Williams monitors an Astrobee robotic free-flyer outfitted with tentacle-like arms containing gecko-like adhesive pads preparing to grapple a “capture cube.”NASA A retired U.S. Navy captain and veteran of three spaceflights, Williams is a helicopter pilot, basic diving officer, and the first person to run the Boston Marathon in space—once in 2007, and again aboard the station in 2025. Originally from Needham, Massachusetts, she brings a lifelong spirit of adventure and service to everything she does. 
      “There are no limits,” said Williams. “Your imagination can make something happen, but it’s not always easy. There are so many cool things we can invent to solve problems—and that’s one of the joys of working in the space program. It makes you ask questions.” 
      Hague, a Kansas native, has logged a total of 374 days in space across three missions. A U.S. Space Force colonel and test pilot, he’s served in roles across the country and abroad, including a deployment to Iraq. 
      “When we’re up there operating in space, it’s focused strictly on mission,” said Hague. “We are part of an international team that spans the globe and works with half a dozen mission control centers that are talking in multiple languages — and we figure out how to make it happen. That’s the magic of human spaceflight: it brings people together.” 
      Expedition 72 Pilot Nick Hague inside the cupola with space botany hardware that supports the Rhodium Plant LIFE investigation.NASA For Williams, Wilmore, Hague, Gorbunov, and the team supporting them, Crew-9 marks the beginning of a new era of space exploration — one driven by innovation, perseverance, and the unyielding dream of reaching beyond the stars.  
      Watch the full press conference following the crew’s return to Earth here. 
      View the full article
    • By European Space Agency
      Video: 00:08:54 Meet Amelie Schoenenwald— biotechnologist, business expert, and PhD in structural biology. Whether in the lab or the great outdoors, she thrives in extreme environments, ready to embrace the adventure of ESA’s Astronaut Reserve.
      In this miniseries, we take you on a journey through the ESA Astronaut Reserve, diving into the first part of their Astronaut Reserve Training (ART) at the European Astronaut Centre (EAC) near Cologne, Germany. Our “ARTists” are immersing themselves in everything from ESA and the International Space Station programme to the European space industry and institutions. They’re gaining hands-on experience in technical skills like spacecraft systems and robotics, alongside human behaviour, scientific lessons, scuba diving, and survival training. 
      ESA’s Astronaut Reserve Training programme is all about building Europe’s next generation of space explorers—preparing them for the opportunities of future missions in Earth orbit and beyond.
      This interview was recorded in November 2024.
      Learn more about Amelie’s favourite space mission.
      You can listen to this episode on all major podcast platforms.
      Keep exploring with ESA Explores!
      View the full article
    • By European Space Agency
      Image: The Copernicus Sentinel-2 mission shows us what is left of the Aral Sea, once the fourth largest lake in the world. View the full article
    • By NASA
      2 min read
      Citizen Scientists Use NASA Open Science Data to Research Life in Space
      2023 Workshop of Analysis Working Group members, Washington, D.C., November 14, 2023. Now, you are invited to join their quest to understand how life can thrive in deep space! Want to learn more first? Join our live virtual event April 17 at 3pm Eastern Time to hear an overview of the OSDR AWG’s operations. Photo: NASA OSDR Team How can life thrive in deep space? The Open Science Data Repository Analysis Working Groups invite volunteers from all backgrounds to help answer this question. Request to join these citizen science groups to help investigate how life adapts to space environments, exploring topics like radiation effects, microgravity’s impact on human and plant health, and how microbes change in orbit.
      Currently, nine Analysis Working Groups (AWGs) hold monthly meetings to advance their specific focus areas. Participants collaborate using an online platform, the AWG “Forum-Space”, where they connect with peers and experts, join discussions, and contribute to over 20 active projects. 
      The AWGs work with data primarily from the NASA Open Science Data Repository (OSDR), a treasure trove of spaceflight data on physiology, molecular biology, bioimaging, and much more. For newcomers, there are tutorials and a comprehensive paper covering all aspects of the repository and the AWG community. You can explore 500+ studies, an omics multi-study visualization portal, the environmental data app, and RadLab, a portal for radiation telemetry data. (“Omics” refers to fields of biology that end in “omics,” like “genomics”.)   
      Each of the nine AWGs has a Lead who organizes their group and holds monthly virtual meetings. Once you join, make sure to connect with the Lead and get on the agenda so you can introduce yourself. Learn more about the AWGs here.
      Have an idea for a new project? Propose a new project and help lead it! From data analysis and visualization to shaping data standards and conducting literature meta-analyses, there’s a place for everyone to contribute. Request to join, and together, we can address a great challenge for humanity: understanding and enabling life to thrive in deep space! 
      Want to learn more?
      On April 17 at 3pm Eastern Time, the NASA Citizen Science Leaders Series is hosting an virtual event with Ryan Scott about these Analysis Working Groups and their work. Ryan is the Science Lead for the Ames Life Sciences Data Archive and the liaison between the Open Data Science Repository and the Analysis Working Groups. Click here to register for this event!
      Share








      Details
      Last Updated Apr 01, 2025 Related Terms
      Citizen Science Biological & Physical Sciences Explore More
      9 min read Interview with Michiharu Hyogo, Citizen Scientist and First Author of a New Scientific Paper


      Article


      2 weeks ago
      2 min read Redshift Wranglers Reach Remarkable Milestones


      Article


      4 weeks ago
      2 min read 2025 Aviation Weather Mission: Civil Air Patrol Cadets Help Scientists Study the Atmosphere with GLOBE Clouds


      Article


      4 weeks ago
      View the full article
  • Check out these Videos

×
×
  • Create New...